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Method and apparatus for processing and forwarding data 

packets 
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BACKGROUND OF THE INVENTION 

1 . Field of -the Inven-bion 

10 The present invention relates to a method for processing 

and forwarding data packets using at least one route table. 

'& 

lA 

2 . Descrip-tlon of the Prior Art: 

m 15 

y' The current standard architecture for a data packet 

router in a computer network comprises a packet 
classification module, a routing module and a packet 

'=4.' 

Uij scheduler module. As a first step, an incoming data packet is 

\^ 20 assigned a class by the classification module and possibly 

Qi also predefined processing is applied to it, such as checking 

Hi 

'^'^ the source address, changing or adding some header fields, 

decrementing the time-to-live (TTL) field, dropping it if the 
TTL value reaches 0 etc. As a second step, the routing module 

25 uses the resulting class and packet header to evaluate the 
packet's further route. For this purpose it contains a 
forwarding information base which usually has the form of a 
route table and merely serves as ^'signpost" for the data 
packets to be transmitted. Next, additional processing may 

30 apply to the packet, before the packet is put, as a third 

main step, in at least one packet queue that is controlled by 
the packet scheduler. Streamlined variants of the above 
process exist, where a packet is directly copied from the 
incoming network interface card that may have its own 

35 forwarding information base to an outgoing interface card. 
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This standard procedure, the so-called "fast data path" 
of a router, is illustrated in Fig. 1. Whereas the route 
table, i.e. the "'signpost" for data packets, can be 
dynamically updated, the procedure itself is a static 
pipeline operating on incoming data packets . The set of 
instructions applied to a packet is rather limited and 
predetermined by the packet's type (class). Reconfiguration 
of a data router, e.g. said updating of the route table, is 
achieved by special purpose ''signaling" protocols. Data 
packets that belong to such a protocol are removed from the 
fast data path and are passed to external processing modules 
capable of handling the signaling protocol. 

Active networks add programmability to a router while 
still adhering to the same architecture (see Fig. 2) : The 
router hosts one or more execution entities EEj to EE^ which 
are responsible for interpreting program instructions 
contained in ''active packets", namely data packets that 
themselves contain the program to be applied to them, or 
other signaling information. 

At a high level of abstraction, the control flow for a 
single packet inside a traditional and possibly active router 
in this standard approach can be depicted as shown in Figure 
3. A program store drives the Central Processing Unit (CPU) 
and the CPU reads from the route table for making routing 
decisions. Accessing the route table is necessary for almost 
every data packet that enters the system. Actual routers may 
have multiple CPUs, program and data stores. 

If a whole classical routing system is regarded from the 
data flow architecture point of view, it represents an 
example of the data flow model: Data items are processed by 
stationary instructions. This is in contrast to the "von 




3 



Neumann" computing model which is the dominant model for 
traditional computing. The "von Neumann" model is 
characterized by one or more control flows in motion that 
operate on data residing in explicitly addressed memory 
5 places. 



SUMMARY OF THE INVENTION 



It is the object of the present invention to provide a 
10 method that enables to process data packets in a computer 

network in the fast data path while simultaneously allowing 
yc^^ to dynamically reprogram the router and to provide at the 

same time a new method for the execution of programs that 

i 1^' 

nJi makes parallel processing possible either in a data flow or 

'^^'^'15 in a '^von Neumann" architecture. 

According to the invention, this object is achieved by 
^ means of a method for processing and forwarding data packets 
comprising the steps of: 
jji 20 - providing at least one route table comprising entries 

containing an input index field and at least one operation 
code or a program for the execution of an operation, 

- assigning a selector serving as indexing datum to each 
data packet, the data packet and its selector being parts 

25 of a token, 

- matching of the selector of a packet matched with the 
input index field of the entries of said at least one 
route table, 

- execution on the matched token of the at least one 

30 operation contained in the at least one matched route 

table entry. 
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According to an other aspect of the invention, an 
apparatus is provided for the processing of data packets in 
the fast data path while it can be dynamically reprogrammed 



at the same time, namely an apparatus comprising the 
following items : 

- at least one route table comprising entries containing an 
input index field and at least one of operation code and 
of a program for the execution of an operation, 

- means for assigning a selector serving as indexing datum 
to each data packet, the data packet and its selector 
being parts of a token, 

- means for matching the selector of a packet with the input 
index field of the entries of said at least one route 
table , 

- means for executing on the matched token the at least one 
operation contained in the at least one matched route 
table entry. 



According to the invention, at least one routing table is 
provided that comprises entries containing operation code or 
a program for the execution of an operation. In this way, the 
programmable packet processing method of the present 
invention replaces the routing module of classical packet 
routers and merges it with the execution entity modules as 
previously introduced. Figure 4 shows, on the same level of 
abstraction as Figure 3, this merging and the resulting 
control path for data packets. The method and apparatus 
according to the invention make it possible that standard 
operating and routing of data packets and dynamic 
reprogramming of the router take place in the same fast data 
path. Thus, reprogramming as well as routing is faster and 
handled more uniformly than by the methods and devices known 
so far. 



Further, an incoming data packet preferably contains 
itself the information on what operation is executed on it by 
having assigned a selector, i.e. an indexing datum to be 
matched with a route table input index field, that matches a 
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route table input index field that belongs to a certain 
operation to be executed on the packet. Therefore, any packet 
most naturally plays an active role instead of the passive 
role of the data packets in standard routing methods upon 
5 which pre-defined operations are executed. A selector may 

even refer to an operation that transfers an other operation 
stored within the packet to the routing table and thus 
activates it. In this way^, the concept of "active packets'' is 
naturally embedded by the invention in the classical routing 
10 concept. 

.^^^ A further advantage of the method according to the 

•iO present invention is that it allows the routing module to 

: =il 
: ; ?' 

particularly quickly access information about the processing 
^ 15 to be applied to a. packet and its path since all the required 
j^^^ information is contained in one selector field which may be a 

'Mi predefined bit field in the header of the packet. 

Conventional routing includes a relatively time consuming 
U4 search for relevant information within a packet header. 

05 20 • ■ 

^ A still further advantage of the present invention is 

that it is completely compatible to prior art routing and 
that the forwarding behavior of a classical routing module 
can be provided. 

25 

The method according to the invention, in addition to 
being a method for routing of packets containing simple data, 
also enables the execution of arbitrary programs . From the 
data flow architecture point of view, the execution model 

30 according to the present invention is an alternate computing 
model to the "von Neumann" model and is a hybrid with 
elements of a data flow- as well as of a "von Neumann" -model 
approach. A structural . similarity to a data flow machine is 
given by the fact that instructions are stored inside the 

35 route table while data items (i.e. selector+packet tokens) 



flow through these operations. However, the method according 
to the invention can also host a ''von Neumann" style of 
program by having one selector+packet token represent one 
flow of control. Each control flow then picks one instruction 
after the other, it therefore operates on the token' s data as 
well as on the route table itself. 

The method according to the invention easily and 
naturally enables parallel computing. It just has to be 
allowed for the possibility that different tokens are matched 
to different route table entries at the same time and the 
corresponding operations are executed simultaneously. 
Parallel computing is even better be taken advantage of if 
the matching of tokens with route table entries is carried 
out in a non-deterministic instead of in a deterministic way. 

Finally, the method according to the present invention 
allows to implement distributed processing on different 
processing entities in a rather straightforward manner. 



DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 

In the following, a detailed description of an embodiment 
of the present invention, namely a routing module, is given 
with reference to Figure 5, which schematically depicts a 
bloc diagram of this embodiment of the method according to 
the invention. 

The routing module to be described in the following is 
based on four elements: 

(a) A plurality of tokens of the form <sel ^pkt> , where sel 
is a selector (or ''tag'') serving as indexing datum and 
pkt is a data packet. 



a multi-set token bag") for storing tokens, 

a route table consisting of entries, each containing the 

following fields: 



selin 


c 


selout 


i 



where sel±n is an in-selector value serving as input 
index field, c an operation code, selout out-selector 
value serving as output index field and i an additional 
state, i may contain information, such as an additional 
selector value, queuing information or other additional 
processing information, to be used depending on the 
status of the packet to be processed, 
a control unit (CU) . 

This new routing module operates as follows: 

A <sel ^pkt> token arrives from the packet classification 
module and is put into the multi-set. 

The control unit picks and removes a token from the 
multi-set . 

The token's selector value sel is used to locate all 
entries in the route table that have a matching selin 
field. Tokens for which no matching in-selector values 
can be found are discarded. Alternatively, they are 
processed by a default processing routine. 

For each matching entry, the corresponding operation c is 
performed : 

If the operation is a FORW (forward) operation, the 
token's packet data is put into a queue of the 
subsequent packet scheduler module. Information about 
which queue to use is either stored in the entry' s 



state field i, is computed from the packet's data, or 
is otherwise provided. 

If the operation is a HALT operation, the token is 
destroyed and no output token is generated. 
For any other operation, one or more new tokens are 
generated that contain the possibly modified packet 
data of the input token. The new tokens' sel values are 
either copied from the selout field of the route table 
entry, or otherwise computed. 

5. New tokens, if any were generated, are put in the multi- 
set . 

6. Processing continues with step 1 or 2 . 

The prior art's routing module's role is to map data 
packets, based on classifications and/or packet header 
fields, to the packet queues of the packet scheduler module. 
This forwarding behavior of the prior art's routing module 
can also be provided by the above specified new routing 
module. To do that, the following steps have to be carried 
out : 

Unicast forwarding : 

(a) The packet classifier (c. f. figures 1 and 2) is 
configured such that it provides a selector for each 
data packet type. Unclassif iable packets are assigned a 
default selector. The packets are subsequently put in 
the multi-set token bag") depicted in Fig. 5. 

(b) The routing table is configured such that each potential 
selector value has exactly one entry. 

(c) A special operation code c is defined and an associated 
procedure is implemented in the route table and an entry 
is defined whose selin value corresponds to the default 
selector. The procedure thus treats the packets that 
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were classified in the default category and which 
therefore need special matching rules (e.g. longest 
prefix for IP addresses: Such an operation most likely 
makes use of the entry's additional state i). The said 
5 operation either outputs a new token whose selector 

value indexes another entry in the route table that 
contains the FORW operation and puts this token in the 
token bag, or it directly performs the FORW. 



10 Multicast forwarding : 

The same approach as above is used, except that multiple 
entries exist in the route table which have the same selin 
value. Two cases are possible: 

(1) The classifier assigns such an ambiguous selector value, 
■ji 15 steps 3 and 4 will automatically take care of multiplying 

the incoming data packet, 
Mi (2) The classifier assigns an unambiguous selector. However, 

one or more of the subsequent operations c create a new 
U|l token with a selector value for which multiple entries 

20 exist . 

Applied in the above way for routing, the routing module 
works as a data flow computing device. A structural 
similarity to a data flow machine is given by the fact that 

25 instructions are stored inside the route table while tokens 

"flow" through these operations. Also, selectors resemble the 
tags of data flow machines that identify the state and 
position of a token. However, we note that the matching and 
execution rules are different from classical data flow 

30 architectures (data-driven vs. demand-driven) as tokens can 
be discarded if there is no matching entry in the route 
table. Also, selectors are explicitly handled by the programs 
themselves instead of being an internal aspect of data flow 
execution , 
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In addition to being a further development of a classical 
routing module, the new routing module also enables the 
execution of arbitrary programs by the virtue of the repeated 
execution of instructions according to the steps 3 and 4 . 
This can be done as follows: 



- Each thread of execution is mapped to one <sel^pkt> token. 

- The program instructions are stored as operations in the 
route table. 

- A token' s selector value points to the next instruction to 
process. It plays the role of the """"program counter" of 
other computing devices. Instructions which generate an 
output token are therefore required to choose the new 
selector value such that it points to the next instruction 
to be processed. This may be done by choosing the selector 
contained in the selout field of route table entries or by 
computing the new sel value . 

Execution of a program flow ends when a selector value is 
matched with a route table entry containing an operation 
that does not generate an output token or when the 
resulting token has no matching entry. 



For executing programs for general purposes, the set of 
instructions has to contain minimal support for branching as 
well as memory access, allowing to conditionally divert 
program flows and to implement procedure calls: 



An instruction that is able to output tokens with 
different output selector values suffices to implement 
branching. The resulting selector value may depend on the 
token's packet data and/or any other state in the router, 
including the route table, the packet classifier and 
packet scheduler, and/or may even be assigned randomly. 
Instructions to add, read, change and remove complete 
entries in the route table provide memory access. It is 
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interesting to notice that such instructions to add, read 
and remove entries from the route table turn the present 
invention' s routing module into a Turing complete 
computing device. 

Together with instructions to store and retrieve selector 
values, e.g, inside a token's data packet, inside the 
route table, or in other places, the branching 
instructions enable procedure calls. 

If the method according to the invention is used in the 
way described above, it essentially is a von Neumann" 
computing device. As each control flow picks one instruction 
after the other, it operates on the token's data as well as 
on the route table itself. This operation mode will be 
discussed further below more concretely by way of examples 3 
and 4 . 

Using the above described tools, the method according to 
the invention also most naturally leads to parallel 
computing. One has only to allow for the possibility that 
different tokens are matched with different route table 
entries simultaneously and to start with more than one token 
representing a program flow. For the case of the parallel 
execution of program flows, basic synchronization primitives 
must be provided: 

By switching off the eligibility of tokens to be picked by 
the CU, i.e. by temporarily removing tokens from the 
multi-set ('''token bag"), execution flows can be suspended. 
Special instructions are provided to make suspended tokens 
re-eligible for execution, either explicitly (barriers, 
queues) and/or by environmental changes (e.g. a timeout or 
a condition to be fulfilled) . 



For some applications based on parallel computing it may 
be attractive not to predetermine the selection of route 
table entries that match a given token. In this case, the 
selection of these route table entries will be carried out by 
the machine instead of the programmer and will therefore be 
non-deterministic instead of deterministic. As a consequence, 
the processor or the processors can optimize its/their work- 
load and thus enable even faster processing. 

By means of the above specified tools, the programmable 
routing module outlined above enables a superset of classic 
router functionality as well as arbitrary programming to be 
implemented. It, however, is by no means the only embodiment 
of the invention and can be extended or modified in many 
respects . 

Instead of one route table as described above, multistage 
route tables or a plurality of route tables can be provided. 
In such a case it is for instance possible to map every 
execution entity (EEi) of a prior art routing module onto one 
route table and in this way to be able to make use of the 
wealth of tools developed for the prior art routers. A 
selector of a token will then not only select the route table 
entry but also the route table of which the entry is part. In 
this way, a packet can jump between the different route 
tables, depending on its selector, the selout values contained 
in the route table and/or other information. Therefore, 
operations contained in different route tables, and for 
instance one operation out of every route table, can be 
executed on a single packet in its path. Alternatively, if, 
for instance, k route tables are present, the selector of a 
token could also be divided into k parts, each of which 
refers to an other route table. 
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One route table entry can also contain more than one 
operation. In such a case, preferably all route table entries 
will have the same number of operations. Further, also 
additional fields or attributes such as fields for the 
5 priority, counters, access control lists, certificates,... 
may be provided for. 

Operation code or a program contained in a route table 
entry can also exhibit a reference to an externally installed 
10 subroutine or any other software and/or hardware based device 
serving as an extension of said operation code or program. 
Further, there may be route table entries that, depending on 

-iO) the selector values and possibly also on the packet data of 

\M 

i^j^ incoming tokens, can implement changes to these extensions as 

^ 15 well as to other modules such as a packet classifier, a 

\^ control unit or a scheduler of a router. 

Si 

Vi 

A route table is a table in the conceptual sense and does 
not have to be a table in the literal sense. Therefore, it 
is*,} 20 can have a data structure that is different from a table 
Ql structure and, for instance, have the structure of an array 

'"^^^ of records or a linked list of memory zones. It can also be 

in a compressed form and comprise auxiliary data structures, 
for instance hash tables, or other lookup mechanisms to 
25 access the route table entries. 



The tokens do not need to have a <sel rpkt> form. The 
selector information can also be contained explicitly or 
implicitly in the. data packet and therefore has to be 

30 extracted or calculated from its contents. For many system 
architectures it will also be advisable to give the tokens 
additional attributes, such as suspended flag, processing 
queue, priority, credentials, access rights, certificates 
etc. In such additional attributes it can for instance be 

35 laid down that a packet is not allowed to make changes to the 



3 



h4 
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route table, that it is to be processed only after a certain 
condition is fulfilled, etc. 

A variety of possible further embodiments of the 
5 invention concerns the data flow architecture. As explained 
above, the present invention relates to an execution model 
(Fig. 5) which is a hybrid with elements drawn from both, the 
"von Neumann" and from the data flow side. 

10 This hybrid approach is well in-line with the less strict 

view on data flow architectures that has emerged in recent 
years (multithreaded computers). However, in the present 
method for data packet processing and forwarding, tokens can 
flow in the network. Thus, data flow items are not confined 
Jli 15 anymore to one central processing unit but are transportable 

over the network. The selector concept, together with the 
Ml ^'programmable route table" and the execution loop model of 

Figure 5, are the key enabler for this approach. The method 
according to the invention is therefore also highly suited to 
ftjj 2 0 be implemented using multiple processing elements. 

M An apparatus according to the invention, namely a router, 

comprises the following elements: 

- A device for receiving, processing and forwarding data, 
25 for instance a computer equipped with appropriate 

interfaces . 

- An implementation of the method for data packet processing 
and forwarding according to the invention on said device, 
for instance a program stored on the computer or a 

30 microprocessor the architecture of which is such that it 

supports the data flow and control flow architecture of 
the method according to any of claims 1 to 12 and 
particularly that it supports the data and control flow as 
schematically depicted in Fig. 5. 

35 



While previously the method and apparatus according to 
the invention were discussed in a rather abstract way^ in the 
following a few examples for router table stored programs are 
given in order to make the invention concrete. The examples 
refer to the routing module comprising one route table having 
entries with four fields described above as embodiment of the 
invention. 

Example 1 : Forwarding Branch 

Using a PASCAL like notation, we aim at implementing the 
following packet handling program with the new routing 
module : 

PROC example_one (s : selector) / 

CONST t: selector ; 

BEGIN 

IF exists a route table entry with ln~selector s THEN 

drop front packet header; 

forward via selector s 
ELSE 

forward via selector t 

FI 

END. 

where the incoming packet has the following layout 

(head) [sel sipayload] (tail) 

and is classified for selector p on entry (thus, initially 
the token has the form <p, [ s | payload] >) . 

This packet format adheres to the convention that 
parameters for instructions and procedures are stored at the 
packet's head. Similarly, this convention will be extended 
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for the subsequent examples and' the packet's tail will be 
used for a stack of return addresses (selectors) . 

The following instructions are needed to implement the 
first example program: 

- NOP token (s: selector) 

token ( ) is a pseudo operation that changes a token's 
selector value to the new value s before the token is put 
back into the token bag. 

The token ( ) pseudo operation can be realized by the stand- 
alone instruction NOP (no-operation) whose selout field has 
the value s: 



selin 


NOP 


s 





JCEX j ump__on_existence ( a , b, c: selector) 

A conditional jump is made i.e., the output token receives 
a new selector value depending on the content of the route 
- table : 

IF exists a route table entry with in-selector a THEN 
token (b) 

ELSE 

token (c) 

FI 

By convention it is assumed that parameter a is stored as 
the first header field inside the token's packet data as 
described above, while jb and c are stored in the route 
table entry of the JCEX instruction instance. 

- JH j ump_to_header ( ) 

The token's new selector value is taken from the token's 



packet header, and the packet length is trimmed 
accordingly : 

VAR s: selector; 

s := pop front of packet header 
token (s) ; 



Using these three instructions, the forwarding branch 
procedure example-one ( ) is implemented by the following route 
table content : 





OP 


selout 


addtl. state 




P 


JCEX 


ti 




jmp to ti if hdr field (s) is 
known, else jmp to t2 


ti 


JH 






pop lidr field and jump 
there (s) 




FORW 




queue id 


fonward 


s 


FORW 




queue id 


forward 



Packets arrive classified for selector p. Thus, program 
execution starts with the first line of the table above. Note 
that the last line of the table above may or may not be 
present: The program will take care of correctly forwarding 
packets in both cases. 

Example 2 : Recursive Procedure Call 

In this example, a procedure will recursively be called 
that pops a header field until it encounters a header field 
with a specific value m. The program should thus work like 
the following 

PROC example__two () ; 
CONST m: selector/ 
VAR s: selector ; 



18 



BEGIN 

s := pop packet header; 
IF NOT (s = m) THEN 
example_two () 

FI 
END. 

where the incoming packet has the following layout: 
[ si I S2 r - - . I in I pay load] . 

In order for the "return addresses" ri of procedure calls 
to be stored, they we will be appended to the data packet's 
tail : 

[ . . . I payload | ri | . . . | rn] 

The following additional instructions are needed for this 
example program: 

- JC j ump_conditional (a, b: selector) 

Conditionally jumps to selector a, i.e. the output token 
has a as its selector value, if the packet's first header 
field is not the null selector. Otherwise, execution 
continues at selector b (the output token obtains the 
selector value jb) . 

- JT j ump_to_tail { ) 

Pops the outermost tail field of the data packet which 
becomes the output token's new selector value. The data 
packet's length is reduced accordingly. 

- POPH pop_header ( ) 

Removes (drops) the first header field of the data packet 
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- PUSHT push_tail { selector s) 

Extends the data packet by the selector value s. 

- XOR xor(s: selector) 

5 Performs a bit-wise XOR operation on the packet's first 

header field with s. 

The following route table implements the recursive 
procedure example-two ( ) . As in the previous example, the 
10 token arrives selected for a selector value p, i.e. it 
initially has a sel value of p: 





selin 


OP 


selout 


addtl. state 




m 


p 


PUSHT 


to 




save return addr tg, jmp to proc 












atfo 




to 


XOR 


ti 


m 


start of proc: compare with m 




t1 


JC 


t2 


t4 


jump to t4 if equal (i.e. first 
header field=0) 


'■ - ?! 


t2 


POPH 


ta 




drop first header field 




ts 


PUSHT 


to 


ts 


save return address ts, jmp to 












proc at to 


q 


t4 


POPH 


ts 




drop first header field 




ts 


JT 






return from proc call 




te 


FORW 




queue id 


forward trimmed packet, end of 
example program 



15 Example 3: S-bream Prograicimlng (Program Downloading) 

This example shows a method to store a program inside a 
remote route table by sending appropriate data packets. This 
is useful for having "path finder packets" to configure a 
20 remote node by downloading a program that will treat a data 
stream's subsequent packets. 
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An external representation of route table entries is 
required that is self -delimiting . The following instruction 
depends on such a format : 

- ADDOP add_operation ( r : route_table_entry ) 

The route_table_entry {Sin/'Op^ Sout and additional state) is 
popped from the packet's header and placed in the route 
table. The length of the data packet is accordingly- 
decreased . 

- HALT haltO 

Discards the current token (i.e., ends the current program 
flow) . 

The following route table program scans a data packet for 
route table entries and installs them. For this, the data 
packet must consist of a sequence of route table entries rei, 
followed by a zero selector field: 

[ rei I . . . I ren I 0-sel | pay load] 

Furthermore, the following program^ the ^'packet handler 
program'', is permanently stored inside the route table. The 
selector DP is a well-known selector to be used for invoking 
the downloading program: 



selin 


OP 


selout 


addtl. state 




DP 


JC 


to 


ti 


start of download proc: 0-sel? 


to 


ADDOP 


DP 




install new table entry, loop 


t1 


HALT 






end of proc 



This download program can be extended by user provided 
enhancements, allowing to "bootstrap" fancier download 
procedures. If for example a "confirmed download" service is 
required, one can use the program above to blindly download 



the modified download program which, instead of executing the 
halt() instruction, returns a confirmation packet. 

Example 4 : Acblve Packet:s 

Instead of having a pre-stored program being applied to 
data packets, this example shows how to implement in-band 
programming where the program to be applied to a packet is 
carried inside the packet itself. Various names are used 
synonymously for such packets: capsules, messengers or active 
packets . 

One approach consists in extending the stream programming 
example above in two ways. The first modification relates to 
the packet format, where we presume that a second (start-) 
selector value follows the 0-sel of the previous example: 

[rei I . . . I ren I 0-sel | start-sel I pay load] 



The second modification concerns the packet handler 
program: 



sehn 


OP 


selout 


addtl. state 




AP 


JC 


to 


ti 


active packet proc: 0-sel? 


to 


ADDOP 


AP 




install new table entry, loop 


t1 


POPH 


t2 




drop null selector 


t2 


JH 






jump to start selector 



The disadvantage of this approach is that the in-band 
program is stripped from the packet, preventing self-routing 
packets to keep their code base as they travel in an active 
network. The second approach below fixes this problem by 
introducing the following concurrency related instructions : 
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QIN queue_in(s: selector) 

The current token is ""put into a token queue", the queue is 
identified by the selector s at the packet's first header 
position, this header field is removed and the packet 
length is adjusted accordingly. 

Only the token which is at the head of the token queue is 
eligible for execution, other tokens in the queue have to 
wait until they advance to the head position. Tokens can be 
in at most one token queue at any time. Switching to 
another queue implicitly removes the token from its former 
queue it was in. Terminating a token (e.g. using the HALT 
operation) also frees the head position of the token's 
current queue . 

FORK fork (a, b: selector) 

This operation outputs two tokens. Both have the same 
packet data but different selector values (a or b) . There 
is no parent/child relation between the forked tokens, 
although the token with the selector a inherits all input 
token attributes, e.g. position in a token queue, while the 
attributes of the other token are reset to some default 
value . 

DUPH dup_head(s: selector) 

Duplicates the selector s at the packet's head. This 
results in a larger data packet that starts with two 
identical header fields . 

DUPT dup_tail () 

Duplicates the selector at the packet's tail. This results 
in a larger data packet that ends with two identical tail 
fields . 

Active packets need to have the internal format 



[id-sel|reil . . . | reni 0-sel | payload | start-sel] 



for being processed by the following extended active packet 
loader program: 



selin 


OP 


selout 


addtl. state 




EAP 


DUPH 


to 




extd active pkt loader: dup id sel 


to 


QIN 


ti 




put thread in the 'id' queue 


t1 


FORK 


t2 


Uo 


fork 


t2 


JC 


t3 


t4 


install the pkts program: 0-sel? 


t3 


ADDOP 


t2 




add new route table entry, loop 


t4 


HALT 






end (and quit the current queue) 


Uo 


DUPH 


Ui 




the forked token, dup id selector 


Ui 


QIN 


U2 




put thread in the 'id' queue, block 


U2 


DUPT 


U3 




dup start selector at the tail 


U3 


JT 






[ump to start selector 



Note that the forked token synchronizes with the main 
token when the later has finished installing the program. 
Synchronization is achieved via the queue that is identified 
by the id selector. Preferably, each active packet is 
assigned its own id value in order to avoid synchronization 
conflicts. Despite the fork() operation^ the main token 
remains at the head of this queue and continues to do so 
during the install loop. The forked token inserts itself into 
the same queue, but will occupy the second position, thus 
block. When the main token halts and thus quits the token 
queue, the forked token advances to the head position and 
starts executing the freshly installed program. At this 
point, the token's packet data is identical to the data that 
the original token had when it entered the new routing 
module . 

Example 5: Beyond a Single Router - Distributed Programming 
and a Router Model with Trivial Classification Module 
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In this example it will be shown that the concept of 
instructions at the route table level that explicitly point 
to the next instruction can be seamlessly extended beyond the 
scope of a single router or route table to a net of 
processing entities. It suffices that a packet is transmitted 
together with its token selector value e.g. by choosing the 
following wire format that contains an initial selector 
field: 

[init-sel I pkt ] 

The inlt selector and the remaining packet payload are 
the two elements required to form a token: Classification of 
an incoming data packet is reduced to reading in the init-sel 
field. Of course, the network architecture that is induced by 
such a router model requires that packet classification is 
performed upstream, or ultimately at the edge of such a 
network . 

With the wire format presented above, selectors can be 
turned into pointers to remote instructions: They allow to 
arbitrarily redirect the execution flow to one or more 
neighbor routers or route tables and to implement distributed 
algorithms. For redirection, one has to replace a route table 
entry by one or more FORW operations that send a packet to a 
remote node where processing will continue. The Sout field of 
the table entry containing the FORW operation can then be 
used for specifying the selector for the remote target 
instruction . 



